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SELF-ROUTING DEVICE FOR SWITCHING 
PACKETS OF DIFFERENT LENGTHS 

CROSS-REFERENCE TO RELATED APPLICATION 

5 This application is a non-provisional application of provisional application 

Serial No. 60/212,333 filed June 16, 2000. 

BACKGROUND OF THE DISCLOSURE 
L Field of the Invention 

1 0 This invention relates to switching circuitry and, more particularly, to a 

self-routing switching device and concomitant methodology that accommodate packets of different 
lengths. 

2. Description of the Background Art 

15 A modern packet switch, including an IP (Internet Protocol) router, should 

efficaciously handle the integrated traffic generated by both narrow-band and broadband 
communication services. Real-time voice communications account for the bulk of 
narrow-band traffic and require small packet sizes to minimize packetization delay. 
Broadband communications, on the other hand, prefer large packet sizes in order to 

20 minimize the cost incurred in the per-packet overhead. 
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Uniform packetization of the mixed traffic, that is, restricting packets to the 
same length regardless of traffic, results in inefficiency, with the ATM (Asynchronous 
Transfer Mode) cell being a prominent example. However, it is generally true that a 
uniform packet size greatly simplifies the design of broadband switching fabrics and, 
5 thereby, somewhat enhances the switching efficiency. A notable example is "self-route 
switching" of uniform packets, where the switching fabric is constructed from the 
interconnection of primitive switching elements and the switching control of each element 
is by just the so-called "in-band" control signals carried by the input packets to this element 
(as discussed in more detail shortly). The extremely distributed nature of the switching 

0 10 control in this manner allows for the construction of a large broadband switching fabric 

from massive integration of most primitive switching elements, typically 2x2 elements. 

1 = i 

B ' The circuitry shown in FIG. 1 is representative of a typical, conventional 

CP 2x2 self-routing switching element 100. With reference to packet "frame" 201 shown in 

15 FIG. 2, wherein packet 205 having header 206 and payload 207 is shown as being 
^ representative of a packet communicated during time frame 201, the construction and 

operation of element 100 is as follows. In packet time frame 201, an independent packet 
represented by the form of packet 205, enters input port 101-1 (Input 0) and, concurrently, 
another packet enters input port 101-2 (Input 1) of the 2x2 element as serially propagated 
20 bits, that is, bit pipelined. The beginning bit(s) of each packet constitutes an "in-band" 
control signal, and is typically conveyed by header 206. Payload 207 conveys the actual 
data, that is, non-control data, communicated by packet 205. The two in-band control 
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signals in the separate headers enter shift registers 102-1 and 102-2, respectively, 
associated with their respective input ports. 



The "connection state" of switching element 100 may be broadly construed 
5 as the manner in which Input 0 and Input 1 are coupled to Output 0 and Output 1 in a given 
time frame. For instance, an exemplary connection state is one whereby Input 0 is 
connected to Output 1 and, concurrently, Input 1 is connected to Output 0 (such a 
connection state is oftentimes referred to as the "cross-state" of a 2x2 element). The 
selection of the connection state of switching element 100 is controlled by connection state 
C 10 circuitry 105 inside control section 103 of element 100. The connection state of element 
2 100 is arbitrary at the beginning of each frame time (e.g., the connection state may be the 

^ connection state remaining at the completion of a previous frame). Thus, the connection 

\j state circuitry 105 uses the two in-band control signals provided by shift registers 102-1 

O and 102-2, respectively, to select a connection state. In particular, the connection state 

¥^ 15 specifies which input (Input 0 or Input 1) is to be connected to Output 0, and more 
P explicitly, which shift register (102-1 or 102-2) may feed its data into the multiplexer (or 

mux) 104-1 associated with Output 0; similarly, the connection state also specifies which 
input (Input 0 or Input 1) is to be connected to Output 1, and more explicitly, which shift 
register (102-1 or 102-2) may feed its data into the multiplexer (or mux) 104-2 associated 
20 with Output 1. Note that it is possible for an input to couple to more than one output. The 
operation of the connection state circuitry 105 is aided by two memory registers: the clock 
counter 106 and the latch status 109. 



-3- 



Li 6 

Thus, the in-band control signal indicates whether its packet is an idle 
expression and, for a non-idle packet, the intended output port(s) of the packet plus 
auxiliary information such as the priority class of the packet. The selection of the 
connection state attempts to route each of the two incoming packets to the intended output 
5 port(s) by the content of their in-band control signals. But, in case of a contention situation, 
e.g., when both incoming packets are of the same priority class and intended for the same 
output port, the selection of the connection state needs to resolve the contention by, for 
example, misrouting or blocking one of the two packets. On the other hand, when a packet 
is merely an idle expression, it is optional for the connection state to route the idle 
O 10 expression to an idle output. 

IB 

In order to relate conventional self-routing switching to the invention 
%j described in the sequel, it is assumed that a connection state always connects each of the 

p two outputs to an input. Thus, when the winner packet in the contention occupies only one 

15 of the two outputs, the loser packet is misrouted to the unoccupied output. Similarly, an 
jp idle expression is routed to some output unless a non-idle packet occupies both outputs. 

As soon as the connection state is selected, it is "latched", that is, 

maintained throughout the duration of the flow of bits (both header and payload) in the 

20 packet, and will be unlatched at beginning of the next packet frame time. Latch status 109 

may, for example, be a 1-bit register that keeps track of latching. Clock counter 106 is reset 

by the signal from frame clock 107; frame boundary markers (e.g., short duration pulses) 

for frame 201 and the next succeeding frame are shown by signals 210-1 and 210-2, 
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whereby signal 201-1 indicates the start of the current frame 201, and signal 210-2 shows 
the start of the next frame. Clock counter 106 is incremented and progresses upon every 
signal from the bit clock 108 based upon the bit-rate of the incoming bits comprising a 
packet. Corresponding to each value of clock counter 106, control section 103 prescribes 
5 commands to control the two shift registers and the two multiplexers. Frame clock 107 and 
bit clock 108 are derived in any conventional manner from the incoming packet stream -- 
for example, from synchronization circuitry (which is not shown because it is conventional) 
which determines frame clock 107 and bit clock 108. 

10 Packet 205 of FIG. 2 illustrates the typical format of a packet. A packet 

may traverse through many primitive switching elements such as element 100 inside a 
self-routing switching fabric, and its in-band control signal for different switching 
elements on its route may be different. Upon entering the switching fabric, the header 206 
of the packet must contain enough information to conveniently derive the in-band control 

15 signal for every switching element on the route. Upon entering each switching element, 
the in-band control signal needs to occupy a certain fixed bit position(s) at the front or near 
the front of the packet. Upon exiting the switching element, the same bit position(s) must 
be occupied by the in-band control signal for the next switching element on the route. Thus, 
each switching element on the route of the packet may make some quick change to the 

20 front bits of the packet. For example, the switching element may consume the leading bit 
of the packet. 
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Primitive switching element 100 exemplified by the above description of 
FIG. 1 functions only for packets of a uniform size. The prior art is devoid of a self-routing 
switching mechanism that accommodates packets of different lengths at a minimal 
additional cost to the hardware. 

5 

SUMMARY OF THE INVENTION 

Certain limitations and other shortcomings and deficiencies are obviated in 
accordance with the present invention by circuitry, and a concomitant methodology, for 
accommodating packets of different lengths at minimal cost to hardware complexity by 
10 configuring a new self-routing switch primitive with an associated switching mechanism 
that accommodates packets of different lengths. Besides the new switch primitive, a new 
packet format is devised for self-routing such packets through a switching fabric 
constructed from the interconnection of the new switching primitives. 



15 In accordance with one broad method aspect of the present invention, a 

method for concurrently routing frames through a switch wherein each of the frames is 
formatted with one of a plurality of formats, includes: (a) identifying the format of each of 
the frames; and (b) controlling the operation of the switch with reference to the format of 
each of the frames. 

20 

In accordance with one broad system aspect of the present invention, a 
system for concurrently routing frames through a switch wherein each of the frames is 
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formatted with one of a plurality of formats, includes: (a) means for identifying the format 
of each of the frames; and (b) circuitry for controlling the operation of the switch with 
reference to the format of each of the frames. 

5 BRIEF DESCRIPTION OF THE DRAWING 

FIG. 1 illustrates generally a schematic of a conventional 2x2 self-routing 
switching element; 

FIG. 2 depicts a conventional format of a packet to of a 2x2 self-routing switching 
element along with the timing scheme of a frame and the frame signals to the switching 

C 

£ 10 element; 

r 1 FIGS. 3 A, 3B, and 3C illustrate the two packet formats to be accommodated by the 

H switching primitive in accordance with the present invention along with timing signals; 

g FIG. 4 illustrates the timing scheme of small packets and the slot signals to the 

y 1 switching primitive; 

tO 15 FIG. 5 illustrates the relations of the two frame clock signals; 

^ FIG. 6 illustrates the block diagram of the simple structure for implementing the 

hardware necessary to construct the enhanced 2x2 switching element in accordance with 
the present invention; 

FIG. 7 illustrates the relations for the recursive application of the dual format; 
20 FIG. 8 is an example of an encoding scheme for the packet headers; and 

FIG. 9 is a flow diagram of the processing of the switch primitive in accordance 
with the present invention. 
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To facilitate understanding, identical reference numerals have been used, where 
possible, to designate identical elements that are common to the figures. 

DETAILED DESCRIPTION 

5 The present invention relates to a new self-routing switching primitive and 

method embodied by the primitive that accommodates packets of different lengths. To 
advantageously effect the method of the present invention, a new packet format is defined. 
The description provides details on the packet format, schematic structure of the primitive 
self-routing element, and transition of the connection state. Logic circuits at a detailed 
C 10 level commensurate with the well-known switching element 100 are not described since 
If such details are readily apparent to someone with ordinary skill in the art. Only those 

I. ~l aspects of the new primitive element relevant to the inventive subject matter are described 

%j in detail. 

15 To simplify the description, but without loss of generality, all primitive 

p self-routing elements are assumed to be 2x2, although the generalization to elements of 

other sizes is straightforward and is readily discernible. 

1. Packet formats 

20 The generic data unit for switching, as guided by the depiction and 

discussion of FIG. 2, is a "frame" as now recast with reference to FIGS. 3 A and 3B - FIG. 

3 A shows frame 300-1 whereas FIG. 3B shows frame 300-2. In each case, there is a frame 

header 301-1 or 301-2, respectively, and communications data manifested by a payload. 
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The timing for each frame 300-1 or 300-2 is analogous to that depicted in FIG. 2, namely, 
each frame arrives in synchronization with the frame clock signal such as exemplified by 
signal 210-1 of FIG. 3C (signal 210-2 is the frame clock signal for the next frame). 

Again, for sake of specificity but without loss of generality, only a large 
packet size and a small packet size are assumed, so there are two formats of the packet 
frame content in correspondence to the two packet sizes. One format of frame content is 
simply a large packet as exemplified by 300-1, which in turn includes a large-packet header 
302 and a payload as in FIG. 3A. The alternative format partitions the frame content into a 
number of "slots" 303-1, 303-2, 303-3, . . . , and possibly some redundant bits 304, that is, 
filler bits; the slots contain "small packet 1", "small packet 2", "small packet 3", 
respectively, as depicted in FIG. 3B. Each slot thus carries a small packet, which includes 
a header 305 and a corresponding payload as depicted for slot 303-2. The frame header is 
always synchronized with the frame clock and serves to identify different packet formats, 
as summarized in FIG. 3C. The timing scheme for the sequence of small packets is 
depicted in FIG. 4; each small packet arrives in synchronization with the "slot clock" signal 
401-1, 401-2, 401-3, . . . , and so forth. Finally, the relation between the frame clock signal 
and the slot clock signal, along with the large and small packet frames, is as summarized by 
FIG. 5. 



When there are more than two packet sizes, the above scheme of packet 
formatting can be generalized by recursively packing a number of packets of one size into a 
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capsule equally large as the next packet size. To simplify the description, only two packet 
sizes are assumed hereafter unless otherwise specified. 

2. Structure of a 2x2 switching element 
5 In comparison with the conventional self-routing switching element 100 of 

FIG. 1, two new components are overlaid on the element 100 to generate the new primitive 
switching element in accordance with the present invention; this structure of the new 
element, designated element 600 in FIG. 6, is implemented as follows: (a) there is an input 
for signaling using the slot signals 401-1, 401-2, 401-3, .... The sequence of slot signals is 
S 10 generically referred as the "slot clock" 601 in FIG. 6; and (b) there are two latch 
2* mechanisms (instead of the one mechanism engendered by latch 109 of FIG. 1) to control 

y connection state 105, namely, one mechanism is activated for the duration of a large packet 

H and the other mechanism for the duration of a small packet. The two mechanisms are to be 

O referred to as "latch" and "lock", respectively. Control section 603 of switching element 

ft 15 600 keeps track of the status of both "latching" and "locking" and stores it in the memory 
Jr: register called the "latch/lock status" 603. Moreover, clock counter 602 is now reset by 

signaling from the slot clock 601 as well as the frame clock signals 201-1, 201-2, and 
bit transitions from bit clock 108 still increment clock counter 602. 

20 3. Self-routing control of the 2x2 switching element 

Upon the frame clock signal 210-1, a frame arrives at each of the two inputs 

to the switching element synchronously. There are two levels in the self-routing control of 

the 2x2 switching element: the frame level and the slot level. 
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The frame clock signal 210-1 unlatches the connection state of the 2x2 
switching element 600 and triggers the frame-level control. The frame header 301-1 or 
301-2 at the beginning of the frame identifies the packet format to be either a large packet 
5 or a number of small packets. Aided by the two memory registers, clock counter 602 and 
latch/lock status 609, the connection state circuitry 105 inside the control section 603 may 
or may not set the connection state during the frame-level control. If the connection state is 
set during the frame-level control, it is latched throughout the whole frame. If neither frame 
contains a large packet, the connection state remains unlatched, that is, "latching" occurs 
5 10 only when at least one large packet arrives at the inputs. (When a frame is merely an idle 
S expression, it is regarded as a degenerated case of the small packet format.) The 

I H frame-level control treats a frame for small packets no differently from an idle expression 

Si and selects the connection state in the way of the conventional self-routing switching as 

O described in Background of the Disclosure. 

ft 15 

P Slot clock signal 601 unlocks the connection state if is locked, but does not 

unlatch the connection state. Clock signal 601 also triggers slot-level switching control, 
which takes effect only when the connection state is not latched. The slot-level switching 
control sets and locks the connection state in a manner analogous to conventional 
20 self-routing switching by regarding the slot as a mini-frame. The connection state locked 
during any particular slot is unlocked by the next slot clock signal 601, so the slot-level 
control is iterated once more in the new slot time. 
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The primary difference between a latched connection state and a locked 
connection state is in the two different clock signals 210-1 and 601 that reset them. Since a 
latched connection state preempts the slot-level control, the 2-level control effectively 
gives priority treatment to large packets. 

5 

As alluded to above, the scheme of packet formatting can be generalized 
into a recursive nested format for N packet sizes; concomitantly, there will be N levels of 
switching control each triggered by signaling from a different clock. Thus the latching of 
the connection state at each level is for the duration of a packet of the corresponding size. 
O 10 Take the example when there are three packet sizes: large, small, and mini. As before the 
*! frame payload 207 of a frame either contains a large packet or is partitioned into slots. 

u] Illustrated in FIG. 7, a slot now contains a slot header 701 and a slot payload. The slot 

Si payload either contains a small packet or is partitioned into mini-slots for carrying mini 

O packets. Each mini packet arrives in synchronization with the "mini-slot clock" signal 

15 710-1, 710-2, 710-3, . . . , and so forth. FIG. 7 also depicts the relation between the slot 
J^f clock signal and the mini-slot clock signal. 

4. Example of frame/packet header in multistage self-routing switching 

A self-routing switching fabric often contains multistage interconnection of 

20 switching elements. A packet routed through such a switching fabric has to traverse 

through a primitive switching element at each stage, and its in-band control signal for the 

switching at different stages may be different. Upon entering the switching fabric, the 

header of the packet must contain enough information to conveniently derive the in-band 

- 12- 



Li 6 

control signal for every switching element on the route. Below, with reference to FIG. 8, is 
an example of the frame/packet header for self-routing switching through a multistage 
interconnected switching elements. 

The frame header 801-1 is a single bit, T , for a large packet; for a frame of 
small packets, frame header 801-2 is a single bit, '0'. 

The large-packet header 802 in n-stage switching is shown in FIG. 8. The 
header of a large packet initially consists of a string of symbols Di, D 2 , . . . , D n . Each 
symbol is the in-band control signal at one stage of switching and is consumed at that stage. 
Thus the header of a large packet upon entering the stage-k switching element consists of 
symbols D k , D k+ i, ... , D n . 

The small-packet header 805 is the same as a large-packet header 802 plus 
an "activity bit", which is T for an active small packet and '0' for an idle expression; this 
is exemplified for the small packet that occupies slot 303-2. 

5. Processing by Primitive Switching Element 600 

The operational processing effected by primitive switching element 600 is 
as follows, with reference to the example covered by FIG. 8; in particular, it is assumed 
that a frame in format 300-1 serves as Input 0 on path 101-1, and a frame in format 300-2 
serves as Input 1 on path 101-2. The starting point for the processing is the arrival of frame 
clock signal 210-1 at the input to control circuit 603. It is presumed that element 600 has 
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synchronized with the frame clock (107), the bit clock (108) and the slot clock (601) during 
prior packet/frame processing. Shift register 101-1 receives the bit T from header 801-1 
as its first bit. Similarly, register 101-2 receives the bit '0' as its first bit from header 801-2. 
In turn, both first bits are detected by the connection state circuitry 105 in FIG. 6, which 
then finds the presence of a large packet and, accordingly, is committed to setting the 
connection state and latching it for the duration of the frame. If it is further presumed that 
element 600 is at the 1-st stage in the multistage switching fabric, then the D l bit in packet 
header 802 is used to route frame in format 300-1. For example, if D^= 0, then frame in 
format 300-1 is routed to Output 0; on the other hand if Dj= 1, then frame in format 300-1 

is routed to Output 1. Since the frame-level control treats the frame 300-2 no differently 
from an idle expression, the frame in format 300-2 is routed to the opposite output in both 
cases. 

Suppose another scenario in which two frames in format 300-2 serve as 
inputs to both Input 0 and Input 1. The header frame (801-2) of each frame contains a '0' 
bit, so the frame-level control does not latch the connection state, but rather leaves the 
decision to the slot-level control. Consider processing the first small packet in each frame 
("small packet 1"). Each small packet has a header (like 805), and suppose each packet is 
an active packet (not an idle expression) - therefore, the first bit in the small packet header 
is a '1'. Next, it is presumed that Dj = 0 for the first one of the packets and D 1 = 1 for the 
second one of the packets, so there is no contention. The connection state circuitry 105 
then sets the connection state of the 2x2 element to the "bar-state", which connects Input 0 

- 14- 



Li 6 

to Output 0 and connects Input 1 to Output 1. To activate the bar-state, connection state 
circuitry 105 signals MUX 104-1 to receive the first packet into Output 0 and signals MUX 
104-2 to receive the second packet into Output 1. As soon as the connection state is set, the 
latch/lock status 609 becomes "locked". 

Once all payload bits in each "small packet 1" are delivered, slot clock 601 
signals the start of the next small packet ("small packet 2") and the connection state is 
unlocked, that is, the latch/lock status 609 becomes "neither latched nor locked". Then the 
first bit in each small packet header is detected to determine if the packet is active or idle. 
If each packet is active, then the D^it in each packet is detected. Next, if it is presumed 

that 0 for both small packets, then there is contention for Output 0. Moreover, assume 

that the resolution of the contention favors the second one between the two small packets. 
The connection state is then set to be the "cross-state" and locked for the duration of this 
slot. The processing now continues in a manner equivalent to that for "small packet 1". 

6. Flow Diagram 

Flow diagram 900 of FIG. 9 depicts the processing effected by element 600 
based upon incoming frames, as follows: 

Process 905: a new frame signal initiates the overall processing of element 600 for 
each frame; 

Process 910: the connection circuitry 105 is unlatched at the start of this iteration; 

-15- 



Li 6 

Process 915: a decision is made as to whether or not the frame contains a large 

packet; 

Process 920: if a large packet is present, connection state of circuitry 105 is latched 
for the duration of the frame; 

Process 925: for the large packet, self-routing is effected using the routing bits in 
the packet header (note that signaling from the slot clock at a time when the connection 
state is latched does not trigger any new control action); 

Process 945: if no frame contains a large packet, then connection state of circuitry 
105 is locked for the duration of a slot; 

Process 950: for the small packet, self-routing is effected using the routing bits in 
the small-packet header; 

Process 955: a frame or slot clock signal arrives; if it is from the frame clock, start a 
new iteration of process 905; 

Process 960: if the clock signal is from the slot clock indicating another slot within 
the frame to be processed, then the connection state of circuitry 105 is unlocked, and a new 
iteration of process 945 is invoked. 

Although the present invention has been shown and described in detail 
herein, those skilled in the art can readily devise many other varied embodiments that still 
incorporate these teachings. Thus, the previous description merely illustrates the 
principles of the invention. It will thus be appreciated that those with ordinary skill in the 
art will be able to devise various arrangements which, although not explicitly described or 
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shown herein, embody principles of the invention and are included within its spirit and 
scope. Furthermore, all examples and conditional language recited herein are principally 
intended expressly to be only for pedagogical purposes to aid the reader in understanding 
the principles of the invention and the concepts contributed by the inventor to furthering 
5 the art, and are to be construed as being without limitation to such specifically recited 
examples and conditions. Moreover, all statements herein reciting principles, aspects, and 
embodiments of the invention, as well as specific examples thereof, are intended to 
encompass both structural and functional equivalents thereof. Additionally, it is intended 
that such equivalents include both currently known equivalents as well as equivalents 
10 developed in the future, that is, any elements developed that perform the function, 
regardless of structure. 



In addition, it will be appreciated by those with ordinary skill in the art that 
the block diagrams herein represent conceptual views of illustrative circuitry embodying 
15 the principles of the invention. 
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